Skip to main content

fastdup By Visual-Layer

fastdup is a tool for gaining insights from large image/video collections. It can find anomalies, duplicate and near duplicate images/videos, clusters of similarity, learn the normal behavior and temporal interactions between images/videos. It can be used for smart subsampling of a higher quality dataset, outlier removal, and novelty detection for new information to be sent for tagging. Just 2 lines of code to get you started:
todo: fastdup clip
fastdup is: Unsupervised: fits any dataset
Scalable : handles 400M images on a single machine
Efficient: works on CPU only
Low Cost: can process 12M images on a $1 cloud machine budget works on CPU only From the authors of GraphLab and Turi Create.

Quick installation

  • Python 3.7, 3.8, 3.9
  • Supported OS: Ubuntu 20.04, Ubuntu 18.04, Debian 10, Mac OSX M1, Mac OSX Intel, Windows 10 Server.
Where XX is your python version.
For Windows, CentOS 7.X, RedHat 4.8 and other older Linux see our Insallation instructions.

What’s new in V1.0?

  • Better support for labels
  • Better galleries
  • A new Python API

Running the code

Existing API is fully supported

Getting started examples

Detailed instructions

User community contributions

Stroke AIS Data
Tire Data
Butterfly Mimics
Drugs and Vitamins
Plastic Bottles
Micro Organisms
PCB Boards
ZebraFish
Whats the difference

Support and feature requests

Join our Slack channel

fastdup enterprise edition

Visual Layer

About us

Danny Bickson, Amir Alush